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Abstract. In this paper we consider a linear stochastic Volterra equation 
which has a stationary solution. We show that when the kernel of the funda- 
mental solution is regularly varying at infinity with a log-convex tail integral, 
then the autocovariance function of the stationary solution is also regularly 
varying at infinity and its exact pointwise rate of decay can be determined. 
Moreover, it can be shown that this stationary process has either long memory 
in the sense that the autocovariance function is not integrable over the reals or 
is subexponential. Under certain conditions upon the kernel, even arbitrarily 
slow decay rates of the autocovariance function can be achieved. Analogous 
results are obtained for the corresponding discrete equation. 



1. Introduction 

In recent years, much attention in quantitative finance has centred on the question 
of whether financial markets are efficient, and whether there is a significant impact 
of past events on the current state of the system, see e.g. Cont [T3]. A mathemat- 
ical way in which this phenomenon can be captured is through the theory of long 
range dependence, or long memory. For continuous time processes, this is mea- 
sured by the autocovariance function of a stationary process being non-integrable 
and polynomially decaying, so it must decay more slowly than exponentially. Pro- 
cesses with long memory also arise in other areas of science such as data network 
traffic or hydrology see e.g. Doukhan et al. |14) . 

In this paper, we describe a class of processes, both in discrete and continuous time 
which exhibit long range dependence through non-exponential convergence of their 
autocovariance functions. In the continuous case, these are solutions of scalar affine 
stochastic Volterra equations of the form 



J k(t- s)X(s)ds S j dt + adB{t) for t > 0, 



(1.1) dX(t) = \aX(t) + 

where B is standard Brownian motion and k is an integrable function. Applica- 
tions of such equations stochastic Volterra equations arise in physics and mathe- 
matical finance. In physics, for example, the behaviour of viscoelastic materials 
under external stochastic loads has been analysed using ltd- Volterra equations (cf., 
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e.g. Drozdov and Kolmanovskii [15). In financial mathematics, the presence of in- 
efficiency in real markets can be modelled by using stochastic functional differential 
equations. Anh et al. [U [2] have posited models for the evolution of asset returns 
using stochastic Volterra equations with infinite memory. 

For affine stochastic functional differential equations with bounded delay, it has 
been shown that stationary solutions always have exponentially fading autocovari- 
ance function, see e.g. Gushchin and Kiichler [3T], Riedle [33]. This is a consequence 
of the fact that, if an autonomous linear differential equation with finite delay is 
stable, then its resolvent converges to zero at an exponentially fast rate, see Hale 
and Lunel |2"3] . 

In order to obtain polynomial convergence results for linear autonomous Volterra 
equations, it is necessary to consider kernels k which decay non-exponentially, 
both for deterministic and stochastic equations. While a substantial literature ex- 
ists in the deterministic case (see e.g., [351 EH 1251 [3 [51 IS]) only a few results for 
non-exponential convergence phenomena of linear stochastic autonomous Volterra 
equations exist, and those that do concern the asymptotic stability of point equi- 
libria. Examples of such papers include Appleby [3j 0] for pointwise convergence 
rates, Appleby and Riedle [5] for convergence rates in weighted X p -spaces, and 
Mao and Riedle for mean square convergence rates [5S]. In particular, polynomial 
convergence rates of the autocovariance function of (|1.1[) have not been recorded. 

In this paper, we examine the asymptotic behaviour of the autocovariance function 
of asymptotically stationary solutions of (jl.ip . To do this, our first class of results 
concerns the exact rate of convergence to zero of the solution of the differential 
resolvent associated with (jl.lj) . namely 

(1.2) r'(t) = ar(t)+ [ k{t-s)r(s)ds for t > 0, r(0) = 1. 



n 



We consider first equations for which the kernel k is positive and integrable with 
infinite first moment. In this case it is only known to date that the resolvent r 
converges to zero and is not integrable. 

In this paper we first show that if the kernel k additionally satisfies a + / °° k(s) ds = 
and the tail integral X(t) :— k(s) ds is a log-convex regularly varying function 
with index a, then the solution r is decays at a hyperbolic rate, according to 

(1.3) lim r{t)t l - a L(t) = 

t— >oo 7T 

where L is a slowly varying function related to k. Corresponding asymptotic re- 
sults are established in discrete time. The discrete analogue of equation (ll.2[) with 
positive summable kernel of infinite moment corresponds to the renewal sequence 
of a null-recurrent Markov chain |20) , and under similar additional assumptions on 
the kernel, the hyperbolic decay of the sequence relies upon well-known results by 
Garsia and Lamperti [T5] and Isaac [23j . 

Our second class of results in this paper employ the convergence rate of the resolvent 
r to investigate the long memory properties of the solution of the Ito- Volterra 
differential equation (jl.lj) and its discrete analogue. It turns out, that under the 
same conditions on the kernel k, the equation (ll.l[) possesses an asymptotically 
stationary solution for < a < 1/2. There also exists a limiting equation which is 
stationary and its autocovariance function c obeys 

(1.4) lim c(t)L* (t)t^ = g 2 r(l -2a)r(q) sin^ro) _ 
t->oo T(l — a) 7r 2 
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Moreover, because c is non-integrable, the process has long memory. Again, corre- 
sponding results hold in discrete time. 

If a > 1/2, no stationary solutions exist and the case a = 1/2 turns out to be crit- 
ical. In this situation, we give necessary and sufficient conditions for the existence 
of a stationary solution and show not only that its autocovariance function has long 
memory, but that it can also decay at an arbitrarily slow rate in the class of slowly 
varying functions. 

In order to give a complete characterization the asymptotic behaviour of the au- 
tocovariance function of (jl.l|) . we also treat the cases a + J °°A;(s)ds < and 
a + J °° k(s) ds > 0. While in the latter case no stationary solution exists, we show 
in the first case, that under weaker assumptions on the kernel k, the autocovari- 
ance function of the stationary solution is integrable. Nevertheless, its decay is very 
slow: the rate of convergence to zero is the same as the decay rate of fc, that is 
hyperbolic. 

Although we have mentioned discrete results only briefly in this introduction, there 
are many reasons to formulate the models (ll.2[) and (jl.ll) in discrete time. When 
modelling dynamic real-world phenomena, it is desirable that properties formu- 
lated in discrete or continuous time should be consistent. In this paper, our results 
demonstrate that the long or subexponential memory are general properties of the 
Volterra model and do not depend on the continuity assumption. Secondly, by ap- 
plying for example a constant step size Euler-Maruyama scheme to the continuous 
equation (jl.ip , we obtain consistent estimates of the decay rate of the autocovari- 
ance function. These decay estimates stabilise appropriately to those obtained in 
the continuous case in the limit as the step size tends to zero. 



2. Discrete and continuous stochastic Volterra-Equations 



2.1. Mathematical Preliminaries. We denote the spaces of real-valued contin- 
uous functions by C([0, oo); R). Let L p ([0, oo);R) (£ p ) 7 p > 1, denote the space of 
real-valued measurable functions / (sequences (f n )nen) satisfying 



/ \f(t)\*dt«X> (^l/n| P <00 
J n=0 



We write / ~ g for x — > xo £ R U {±00} if \im x ^ Xo f(x)/g(x) = 1. 

A function L : [0, 00) — > (0, 00) is slowly varying at infinity if for all x > 0, 

A function / varies regularly with index a £ R, / G RV 00(a), if it is of the form 
(2.2) f(t) = t a L(t) 

with L slowly varying, see e.g. Feller [T7], Ch. VIII. 8. 

The definition of a regularly varying sequence is a counterpart of the continuous 
definition |12j : a sequence of positive numbers (c„) ti6 n is said to be regularly varying 
of index p € R (c is slowly varying if p = 0), if 

lim -i^i = \p i for every A > 0, 

71— >00 C n 

where [x] denotes the integer part of 1 6 R+. A regularly varying sequence is 
embeddable as the integer values of a regularly varying function: the function c(-), 
defined on [0, 00) by c(x) := cr x i is regularly varying of index p. 
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2.2. Continuous time Gaussian Volterra equations. We first turn our atten- 
tion to the deterministic Volterra equation in R: 

(2.3) x'(t) = ax(t) + [ k(t- s)x(s) ds for t > 0, x(0) = x . 



o 



For any xq S R there is a unique R-valued function x which satisfies (|2.3[) on [0, oo). 
The so-called fundamental solution or resolvent of (|2.3I) is the real-valued function 
r : [0, oo) R, which is the unique solution of the equation (jl.2[) . 

Let (f2,J-", P) be a probability space equipped with a filtration (J-t)t>o, and let 
B = {B(t) : £ > 0} be a one-dimensional Brownian motion on this probability 
space. We will consider the stochastic integro-differential equation of the form 

dX(t) = (aX(t) + k(t- s)X(s)ds^j dt + adB(t) for t > 0, 
X(0) = X , 

where fc is a continuous, integrable real-valued function, and a is a non-zero real 
constant. The initial condition Xo is a real-valued, .^-measurable random vari- 
able with E|Xo| 2 < oo which is independent of B. The existence and uniqueness 
of a continuous solution X of (|2.4j) with X(0) = Xq P-a.s. is covered in Berger 
and Mizel [1 , for instance. Independently, the existence and uniqueness of solu- 
tions of stochastic functional equations was established in Ito and Nisio [51] and 
Mohammed [31) . In fact, X has the variation of constants representation 

(2.5) X(t) = r(t)X + [ r(t- s)adB(s), t>0. 

Jo 



We first discuss the existence of asymptotically stationary solutions of (|2.4p . It 
transpires that the critical condition to guarantee stationarity is that the funda- 
mental solution r of (|2~3)l is in L 2 ([0, oo); R). 

Theorem 2.1. Let k G L 1 ([0, oo); R) fl C([0, oo); R). Suppose the fundamental 
solution r of (|2.3p obeys r e L 2 ([0, oo); R). Let a 6 R \ {0}. Let X be the solution 
of (|2.4I) . Then for every t > there exists a real-valued function c such that 

poo 

(2.6) c(t) := lim Gov(X (s),X(s + 1)) = a 1 \ r(s)r(s + 1) ds. 



The result follows directly from (|2.5I) . and the fact that Xo is independent of B. 

The following theorem shows that (|2.4I) has a limiting equation which possesses 
a stationary, rather than an asymptotically stationary solution. To this end, let 
B\ = {Bi(t) : t > 0} and B2 = {^(t) : t > 0} be independent standard Brownian 
motions, and consider the process B — {B(t) : t £ R} defined by 



(2.7) B{t) 



B^t), t>0 
B 2 (-t), t<0. 



Then B is a standard Brownian motion defined on the whole line. 

Theorem 2.2. Let k e i 1 ([0, 00); R) n C([0, 00); R). Suppose the fundamental 
solution r of obeys r G L 2 {[0, 00); R). Let a e R \ {0}. Let B = {B{t) : t 6 

R} be the standard one-dimensional Brownian motion defined by (|2.7[) . Then the 
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unique continuous adapted process which obeys 



(2.8) 



dX(t) = [aX(t)+ k(s)X(t- s)ds) dt + adB(t), t>0 



X(t)= / r(t- s)adB(s), t<0, 

is given by 

(2.9) X(t)= I r(t-s)adB(s), t £ R. 

Moreover, X is a stationary zero mean Gaussian process with autocovariance func- 
tion given by 

(2.10) c(t) = Gov(X(s),X(s + t))=a 2 r(s)r(s + t) ds. 

Jo 

It is clear that if r is in L 2 ([0,oo);R) that X defined by (|2.9p is a stationary zero 
mean Gaussian process with autocovariance function given by (|2.10[) . To show that 
X satisfies (|2.8|l requires more work, and a proof is given in Section [51 

Theorem 12.21 provides direction for the investigations in this paper. It is readily 
seen that r £ L 1 ([0,oo);R) implies c 6 L 1 ([0, oo);R). Therefore in order to possess 
long memory but still to have stationary solutions, we need to consider conditions 
on the kernel k in (|2 .3[) such that the fundamental solution r of (|2.3p obeys r £ 
L 2 ([0,oo);R) but r 0£ x ([O,oo);R). 

Section [3] gives an example of how this can be achieved. The crucial hypotheses 
on k is that it is regularly varying and its tail integral is log-convex: this enables 
us to prove that r is regularly varying and to determine the exact rate of decay of 
r. We then show how the asymptotic behaviour of c can be inferred from r when 
r is regularly varying in such a way that r £ i 2 ([0, co);R) but r i 1 ([0, oo); R). 
The results enable us to determine the exact rate of decay of the autocovariance 
function c in terms of the rate of decay of k. 

2.3. Discrete— time Volterra equations. Let (f2,.F, P) be a probability space 
equipped with a filtration (J„)„ 6 n- We consider the discrete version of (|2.4[) : 

n 

X n+ i - X„ = aX n + kjXn-j + £ n+ i, n > 0, 

(2.11) 

Xq = X , 

where k is a positive summable kernel, a :— — 5Zj=i and £ = {£„ : n£N} is 
a sequence of independent, identically distributed random variables with E(£ n ) = 
0, E(^. 2 ) = a 2 > for all n £ N. xo is an J^-measurable random variable with 
E(xq) < oo which is independent of £. Let r — {r n : n £ N} denote the fundamental 
solution of (|2.11j) . i.e., the unique solution of 

n 

(2.12) r n+ x-r n = ar n + 22kjr n -j, n>l, r = 1. 

For more information on Volterra difference equations, the reader is referred to the 
book of Elaydi [16 . An analogous result to Theorem 12.21 holds for (|2.1ip : 
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Theorem 2.3. Suppose that k G £ and the fundamental solution (|2.12[) obeys 
r 6 f 2 . Then there is a unique adapted process X which obeys 

oo 

X n+1 - X n = aX n + ^ k i X n-j + Cn+i, n>0; 

(2-13) „ 3=1 

X n = ^ r «-i£i> n<0, 

j=-oc 

where £ is extended to n G Z by taking an independent copy I; 1 of £ ( defined on the 
same probability space) and setting £_ n = n G N. X is a stationary zero mean 
process with autocovariance function given by 

oo 

(2.14) c(h) = Cov(A„, X n+h ) = a 2 ]T ^n+h, h G N. 

n=0 

Again, we are able to show that if (fc„) rl6 N is a so-called Kaluza-sequence, then 
r satisfies r G £ 2 but r ^f 1 with exact rate of decay specified. From (|2.14p we 
can deduce the exact asymptotic behaviour of the autocovariance function of the 
stationary solution. 



3. Long memory in the continuous equation 

3.1. Asymptotic Behaviour of the Deterministic Resolvent. This section 
gives the exact rate of decay of the solution of a scalar linear Volterra differential 
equation with a non-integrable solution r which nonetheless obeys r(t) — > as 
t — >• oo. Suppose that a + L k(s) ds = and let k satisfy the following conditions 

(CI) k G ^([0, oo); (0, oo)) n C*([0, oo); (0, oo)), 

(C2) 1 1-> log A(£) is a convex function, where 

/>oo 

(3.1) A(t) := / fc(s)(te, 



(C3) A(f) = L(t)t " with a G (0, 1) and a slowly varying at infinity function L. 

Remark 3.1. The last two conditions are satisfied, if A; is a completely monotone 
function such that k G RV 00 (— 1 — a). Condition (C2) is equivalent to 

(C2*) ; - - — - is non-increasing in t for all T > 0. 

X(t + T) 5 

Proofs can be found in Miller |30) . 

Condition (CI) implies existence of a unique continuous function r which is a so- 
lution of the integro-differential equation (jl.2D . In particular, it follows from (C3) 
that k obeys 

/•OO 

(3.2) / sfc(s) ds = oo. 

Jo 

In this case it is only known that the differential resolvent r satisfies 

(3.3) limr(i) = 0, r £ ^((0, oo); (0, oo)). 
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Theorem 3.2. Suppose that k obeys (Cl)-(CS). If r is the unique continuous 
solution of (jl.2p . then 

(3.4) lim r{t)t l - a L{t) = 

t—>oo 7T 

Hence for a G (0,1/2) we have r G L 2 ([0, oo); (0, oo)) but r £ //([O, oo); (0, oo)) 
due tore RVoo(/x) for /z = a - l G (-1, -1/2). 

Proof. We note that A G C* 1 ((0, oo); (0, oo)). Evidently A is positive, non-increasing, 
satisfies A(i) — > as t — > oo. Though, by virtue of (C3) this happens so slowly that 
A L 1 ([0, oo);]R). 

Since r G C 1 ((0, oo); (0, oo)), we can also introduce the function p = —r'. 

By differentiation of the function f(t) = r(t) + J" X(t — s)r(s) ds, and using (|1.2p . 
we see that /'(t) = 0. Since /(0) = r(0) = 1, we have 

(3.5) r(t)+ ( X(t - s)r[s) ds = 1, t > 0. 
Therefore, 

d ' 



p(t) = -r\t) = - f -1 + ^ A(,s)r(i - a) ds 

\(s)r'(t- s)ds + \(t)r(0) = X(t) - I X(t-s)p(s)ds 



Hence p is the integral resolvent of A. Now by (C2) and and Theorem 1.2 in [2"8] . 
it follows that 

/•OO 

(3.6) < p(t) < X(t) for all t > 0, / p(t)dt = 1, 

Jo 

particularly implying < r(t) < 1 for all t > 0. Since A(i) > 0, we may define a 
measure AbyA([0,i]) = / A(s)ds. Then 

w A («) := / e~ zt A(dt) = X(z). 



By (C3), it follows that A G RVoo(l — a), so as 1 — a > 0, we can apply Theorem 
XIII.5.1 in pi] to get 

(3.7) A(t) = cj a (t) - r(-a + 2)A(l/r), as r -> 0. 

Next, as r(t) > for all t > 0, we may define the measure [7 by U([0, t}) = f Q r(s) ds. 
Then := U'(t) = r(t) obeys u'(*) = r'(t) = -p(t) < for all t > 0. Furthermore 

p OO /» OO 

uju(z):= e- zt U(dt)= e - zt r(t) dt = f(z). 
Jo Jo 

Since X(t) —> and r(t) — > as t — > oo, A(z) and f(z) exist for 3?(z) > 0. Therefore, 
by (|3.5I) . we have 

r(z) + X(z)r(z) = -, U(z) > 0. 

Therefore, for r > 0, 

Wu(t) = r(r) = 



r + rA(r) 
Now, by ([37f)l 

rA(r) - r(-a + 2)tA(1/t), asr^O. 
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Because A e RV^-a + l), A x (r) := rA(l/r) obeys Ai G RV (a). Since a G (0, 1), 
t + rA(-r) - T(2 - a)Ai(r) = T(2 - a)rA(l/r) as r ->• 0. Thus 

(3.8) uu(t) = \—-T^ ! Ann =\l{1/tI asr^O, 

t + t\{t) T(2 - a)rA(l/r) r Q 

where 

1 t q_1 
i(1/T) = r(2-a)A(l/r)' 

which is a slowly varying function by virtue of the fact that A G RVoo(— a + 1). 
Then, as U has a monotone derivative u, and (|3.8[) holds, Theorem XIII. 5. 4 in [TT] 
implies that 

U M t-t* 0-1 ^^). asi^oo. 

r(«) 

Since it(t) = r(i), by the definition of L 

1 „_i 1 £~ Q+1 1 1 

r m ~ — rt • — ; , ; ; = — — — ; - --7 . as £ — ^ oo. 

w r(a) r(2-a) A(i) r(a)r(2 - a) A(i) ' 

Moreover, we have from Proposition 1.5.8 in [TT], that 

1 



Hence, 



A(t)= s- a L(s)ds t l ~ a L(t), ust^ 

' 1 — a 



. . 1 „ T . . 1 — a sin a7r 

lim r(t)t 1 ~ a L(t) = 



t^oo w w r(a)r(2 - a) 7r 
as required. □ 



For the sake of completeness, we also study the case where A, defined as in p. II) . 
satisfies A G RVoo(— a) with a > 1. It turns out that in this case r converges to a 
positive limit and hence cannot be asymptotically stable. 

Corollary 3.3. Suppose that k satisfies (CI) and (C3) with a > 1 and that a + 
J k(s) ds = holds true. Then, J Q sk(s) ds < oo and 

(3.9) lim r(f) = ( 1 + / sk(s) ds ' 



Proof. Since A is continuous satisfying A(0) = J °° k(s) ds < oo and A G RVoo(— a) 
with a > 1, we also have A G i 1 ([0, oo); (0, oo)) n C([0, oo); (0, oo)). Moreover 

POO POO 

/ X(s)ds= / sk(s) ds < oo. 
Jo 

Then, Theorem 4.2 in [8] yields flU}. □ 



3.2. Asymptotic behaviour of the autocovariance function. In this section 
we state our second main result, Theorem 13.41 which characterizes completely the 
asymptotic rate of convergence of the autocovariance function c(t) of the solution 
of (|2.8p for the case when a = — k(s) ds. In the case where < a < 1/2, 
it turns out that for the kernels k satisfying (C1)-(C3), c(t) resembles the power 
law function t 2a ~ l for large values of t and hence exhibits long memory. The case 
where a = 1/2 is more subtle; indeed, for some such k we have r G" £ 2 ([0, oo); K). 
If r G L 2 ([0, oo); R), it is still possible to determine the rate of decay of c, which 
continues to exhibit long memory. Perhaps the most interesting aspect of this result 
is that arbitrarily slow rates of decay of c in RVoo(O) can be obtained. 
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Theorem 3.4. Suppose that k satisfies (C1)-(C3) with a G (0, 1/2). Let r be the 
solution of p.2j) . Let a G R \ {0} and B = {B(t) : t G M} be the standard one- 
dimensional Brownian motion defined by (I2.7p . Then there is a unique stationary 
Gaussian process X which obeys ((27 

dX(t) = (aX(t)+ [ k(s)X(t- s)ds) dt + adB(t), t>0 



X(t)= / r(t - s)adB(s), f < 0. 

J — oo 

The autocovariance function c(-) = Cov(X(s), X(s + ■)) satisfies 



(3.10) lim c(t)L 2 {t)t 



1-2* = a 2 



r(l - 2a)T(a) sin^Tra) 



t-*oc r(l — a) 7r 2 

Proof. The proof of the theorem can be found in Section [7] □ 
Example 3.5. Let a G (0, 1/2) and 

(3.11) k(t) = - / -T — rrr , t > 0. 

Then, A(t) = l/(a(l + t) a ), t > 0, and since L(i) — > 1/a as t — > oo, we obtain the 
following convergence rate of the autocovariance function: 

eft) 2 sin(mr)r(l - 2a) 
km „ v \ = o~ — , . 

t^oo t 2*-i TiT(-a) 2 

We now consider the interesting and critical case where a = 1/2. Depending on 
the properties of the slowly varying function L, both r g 1 L 2 ([0, oo);R) as well as 
r G L 2 ([0, oo); R) is possible. We first determine the rate of convergence of the 
autocovariance function. 

Theorem 3.6. Suppose that k satisfies (CI), (C2) and k(t) = L(t)t~ 3 / 2 , t > 0, 
with a slowly varying function L. Then, r G L 2 ([0, oo); R) if and only if 

1 

Moreover, if (|3.12[) holds true, then 
Proof. Theorem 13 . 2 1 yields that 

(3.13) lim r(t)t 1/2 L(t) = lim r(t)k{t)t 2 = -. 

t— >oo t— >oo 7f 

Since r is continuous on [0, oo), r G L 2 ([0, oo); R) if and only if 

1 f°° 1 , 

■ at — I - , ; „ at < oo. 



(3.12) / — -di< 



t 4 fc(s) 2 y x *L(i) 



In this case we denote by 



a 2 f°° 1 



The integrand of / is regularly varying with index — 1. Then, by Karamata's 
Theorem (see e.g. [TT], Theorem 1.5.11) we obtain 

(3 - 14) ^mm^ ' for ^ 00 - 
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Moreover, with QS7I5} and (13~T1)) it holds that 

tr(t) 2 t 

(3.15) lim — Y- = lim r{t) 2 t 4 k(t) 2 lim -ttt^ttt^ = 0. 

We write 

W) = J(t)J r{s)r{t + s) ds + W)j t r{s)r{t + s) ds =: Il{t) + h{t) ' 1 - °' 

By (|3.6I) . r is positive and non-increasing, hence we obtain the following upper 
bound for hit)'- 

(3.16) I 2 (t)<—J r(s) 2 ds, t>0. 

The denominator and the numerator in Q3.16P tend to zero as t tends to infinity, 
therefore, we may apply L'Hospital's rule to obtain 

2 roo 

(3.17) lim ■— / r{sfds = lim 7r 2 r(i) 2 i 4 fc(t) 2 = 1. 

t->oo f(t) J t t^oo 

On the other hand, 

a 2 f°° a 2 f°° 

(3.18) i 2 (t)>—j r { S + t) 2 ds = — J r( S ) 2 ds, t > 0. 

By p.ISp we have 



(3.19) 



1 f 2t tr(t) 2 
lim — - / r(s) 2 ds < lim — y~ = 

*-»"» /(*) Jt ~ /(*) 



Combining ([3TT5]) . (j3~T71) . (j3~T51) and (l3~T5)) we obtain lim t ^ 00 / 2 (t) = 1- The 
term Ii(t) vanishes as t tends to infinity: applying Karamata's theorem to r £ 
RVoc.(— 1/2) and using (13.151) . we obtain 

, h(t) , Ht) f* , , , , fcrMds trit) 2 , ir(i) 2 

lim -i^ < lim -V4 / r(s) ds = lim J ° = 2 lim — V4- = 0. 

This completes the proof. □ 

To see that it is possible to obtain arbitrary rates of decay for c in the class of slowly 
varying functions which tend to zero, we consider such a function 7 £ RVoo(O). We 
demonstrate this claim, under a mild technical assumption on 7. 

Corollary 3.7. Suppose that 7 is in ^((O, 00); (0, 00)), 7(f) -> as t — > 00 ana 
f/ia£ —7' 6 i?Voo(— 1). TTien 7 £ i?Voo(0) and i/iere exists L £ .Ry^O) which 
satisfies (|3.12p and 

,00 j 

(3.20) / ds ~ 7ft), as i 00. 
j t sL (s) 

Proof. For any T > < > 0, we have 7(T) - 7 (<) = J t 7 '(s)ds. Letting T — > 00, we 
see that 7(f) = J"°° — 7 '(s) ds. —7' is integrable because 7 (t) — > as f — > 00. The 
fact that —7' G RVoo(— 1) and is integrable forces 7 to be in RVoo(O). Define the 
function L : [1, 00) — >■ (0, 00) by 

(3.21) L 2 W = ^ 
Clearly L £ RVoo(O). Moreover for any T > 1 



T I rT 



si 2 (s) 



ds= / - 7 '(s)ds = 7(1) - 7 (T). 
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Since j(T) — > as T — > oo, it follows that L obeys (|3.12[) . The asymptotic relation 
(|3.20j) is an obvious consequence of the construction of L. □ 

Remark 3.8. By applying Theorem 13. 61 it can be seen that if k(t) ~ t~ 3 ^ 2 L(t) as 
t — > oo, where L is given by fl3HI]), then c(t) ~ a 2 /w 2 j(t) as t -> oo. Therefore, 
functions k exist such that the rate of convergence of the autocovariance function is 
an (essentially) arbitrary function in RVoo(O). For example, c(t) can decay to zero 
at a rate asymptotic to (log log log •• Tog t)" 1 as t — > oo, where there are finitely 
but arbitrarily many compositions of logarithms. 



4. Long memory in the discrete equation 



In this section we study the discrete counterparts to equations ljl.2|) and (|2.4[l for 
some summablc kernels k with infinite mean. 



4.1. Asymptotic Behaviour of the Deterministic Resolvent. Let us first 
consider the deterministic equation (|2.12D with a + J^JLi kj = 0. If 1 + a > and 
{k n )n>i has infinite mean, the classical renewal theorem yields that r n converges 
to zero as n tends to infinity. If (k n ) n >i has a regularly varying tail (Garsia and 
Lamperti [18] . Theorem 1.1) and (r n ) ne N is monotone non-increasing (Isaac |23j . 
Theorem 3.1), the exact convergence rates are also known. 

In this section we prove that if the tail ( fc, ) is a so-called Kaluza se- 

V J_ J n>l 

quence, which is a discrete analogue of log-convexity, then the sequence (r n ) n(E N is 
monotone non-increasing and we can apply the above mentioned theorems. 

Theorem 4.1. Let (k n ) n >i be a positive sequence such that 53fci — 1- More- 
over, let \ n := J2jL n n — 1' satisfy: 

(C2') (A„)„>i is a Kaluza sequence, that is }? n < A n _iA„ + i for all n > 1, 

(C3') X n = L(n)n~ a , where < a < 1 and L(n) is a slowly varying sequence. 

Then 

hm n L(n)r n 



Proof. Since (L(n)) ne ^ is slowly varying, so is the function x *-> L([x]). Since 
1 + a > 0, we can apply Theorem 1.1 in TB] to obtain the result for 1/2 < a < 1. 
For a < 1/2 the claim follows from [23], Theorem 3.1 if the sequence (r„)„>o is 
monotone non-increasing. To show this, we define 

n-1 

On := r n + ^ fjXn+i-j, n>0, 

3=1 

to obtain 

n-1 

O-n+l — O-n = r n+l ~ Tn + /~l(\n+l—j ~ ^n-j) r i + r nM 

3=0 
n-1 

— ?n+l T*n ^ ^ kn—j^j ^n^ 

= 0. 
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Hence, (a„) n >o is a constant sequence and equals ao = ro = 1- With A n := 
— (i" n — r„_i) we have 

n— 1 n—2 

= a„ - a„_i = -A n + rjX n -j ~ rj\ n -i-j 

3=0 j=0 
n-l 

= -A„ + ^2 X n -j(rj - rj-i) + X n 

3=1 
n-l 

= — A„ — S ' A„_jAj + A ri . 

3=1 

Therefore, (A n )„>o satisfies the recurrence relation 

n-l 

(4.1) A„ = A„ - Yj X n-j&j- 

3=1 

Since (A„) n >o is a Kaluza sequence, it follows from [34] that A„ is non-negative for 
all n > 0. Hence, the sequence (r n ) n >o is non-increasing and the claim follows. □ 

4.2. Asymptotic behaviour of the autocovariance function. Now we are able 
to state the discrete analogue of Theorem [ 



Theorem 4.2. Suppose that k satisfies the assumptions of Theorem \4-l\ with a £ 
(0,1/2). Let r be the solution of (|2.12p and £ = {£„ : n £ Z} be a sequence of 
random variables defined as in Theorem \2.3[ Then there is a unique stationary 
process X which obeys (|2.13p : 

oo 

X n +i — X n = —aX n + kjX n -j + n > 0; 

3 = 1 

n 

X n = ^ r n-j£,j, Tl < 0. 
j'=-oo 

The autocovariance function c(-) = Cov(X ni X n+ .) obeys 

(4.2) lim c{h)L\h)h^ = yj^im . sin2 ( TO ), 

h-yoa T(l — Of) IT 2, 

Proof. The stationary solution is given by X(n) = J2'j=-oo r n-j£,j> n £ Z, and its 
autocovariance function obviously satisfies (|2.14|) . Since the sequence (L(n)) ne ^ is 
slowly varying we obtain with Theorem 14 . 1 1 for all A > 

l — a ~,l — a 



HAn] _ ,. L{n)n 



n 



lim = lim — — = lim 

n->oo r„ n-»-oo [AnJ 1 Q _L([AnJ) n->oc [AnJ 1 



Hence the positive sequence (r n )„ e N is regularly varying with index a—1. Therefore, 
as mentioned in Section al! the function r(x) := rr x i , x > 0, is also regularly varying 
and we may write 

/>oo 

c(h) = a 2 / r(ar)r(o; + h), h £ N. 



With Theorem 1 7. II we obtain 

lim ^ = L. 
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Following the steps of the proof of Theorem 13.41 we obtain (|4.2j) . □ 



5. SUBEXPONENTIAL DECAY OF THE AUTOCOVARIANCE FUNCTION 

In this section we study the properties of the autocovariance function of the sta- 
tionary solution of the main continuous- and discrete-time equations and 
(l2~TTj) if the kernel k is again regularly varying with index — 1 — a, a > but now 
a + J k(s) ds < or a + J^^Li k n < holds respectively. 

Then, A: is a subexponential function or sequence in the sense of Appleby et al. 
In this case, the fundamental solution in both discrete- (Theorem 3.2 in [6]) and 
continuous-time (Theorem 15 in [5]) decays at the same rate as the kernel k. Since k 
is regularly varying with parameter —a — 1 < —1, r 6 L 2 ([0, oo); R) ni 1 ([0, oo); R). 
This implies that the autocovariance function of the stationary solution is inte- 
grable. The next results show that nevertheless the autocovariance function decays 
very slowly: it converges to zero at same rate as the kernel k, that is polynomially. 

Remark 5.1. If a + / °° k(s) ds > 0, then the fundamental solution grows expo- 
nentially: The characteristic function of r, a function h which satisfies f(z) — 
l/h(z), #tz > 0, is given by h(z) = z — a — k(z), z G C, and satisfies h(0) = 
—a — L 00 k(s) ds < 0. Since k is positive, we obtain for x > 

/•oo />oo 

h(x) = x — a — / e~ xs k(s) ds > x — a — / k(s)ds, 
Jo Jo 

which is positive if x > a + k(s) ds > 0. Therefore, by the intermediate value 
theorem, there exists a positive root of the characteristic function. By the stan- 
dard theory of Volterra equations this implies that the fundamental solution grows 
exponentially. Hence, the case a+ J k(s) ds > is not interesting for our research. 

5.1. Continuous time stochastic equation with subexponentially decay- 
ing memory. Suppose k G C([0, oo); (0, oo)) satisfies 

(51) k G RVoo(-l - a) for a > 0, 

(52) a + J °° k(s) ds < 0. 

Theorem 15 in [S] yields, that the fundamental solution of (11.21) converges to zero 
at the same rate as k: 

(5.1) lim ^ = ? =: L c , 

^ook(t) ( a + f™k(s)ds) 2 

Moreover, r is also subexponential. Since r is also square integrable, the stationary 
solution of (|2.8I) exists and the exact rate of decay of the autocovariance function 
can be determined. 

Theorem 5.2. Suppose k satisfies (SI) and (S2). Let r be solution of (II. 2j) . Let 
<r G R \ {0} and B be the Brownian motion defined by (|2.7[) . Then, the autoco- 
variance function c(-) = Cov(X(s),X(s + •)) of the stationary solution of 
satisfies 

(5.2) lim = , > 0. 

*-"»*(*) (-a-J^k(s)ds) 3 



Proof. The autocovariance function of the stationary solution is again given by 
(|2.10[) . Theorem 1.8.3 in [TT] yields, that there exists a decaying function A with 
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k(t) ~ X(t) for t — > oo. Since r is integrable, we choose for an arbitrary e > a 
sufficiently large T > 0, so that 2L C \r(s)\ ds < e. We now write 



(5.3) 



'r(t + s)r(s) 
W) 



ds 



\(t + s) k(t + s) 



r(s) ds- 



•X(t) r(t + s) X(t + s) 
k(t)X(t + s) X(t) 



r(s) ds. 



o k(t + s) k{t) 

The second integral is negligible: since A is decreasing and r(t)/X(t) — > L c for 
t — > oo, the integrand is bounded for sufficiently large t by 2L c \r(s)\. Hence 

r(t + s)r(s) 



lim sup 



k(t) 



■ ds 



< 2L r 



\r(s)\ ds < e. 



Let us now consider the first integral in (|5 
orem 1.5.6) we obtain 

k(t + s) 



With Potter's bound (cf. [IT], The- 



(5.4) 



k(t) 



— > 1, t — > oo, 



uniformly in s for all s < T. Therefore for all sufficiently large t 



(5.5) 



sup 

s<T 



k(t + s) 



k(t) 



< 2 and sup 

s>0 



r(t + s) 



k(t + s) 



< 2L r 



Using dominated convergence theorem we obtain 
rT r(t + s) k(t + s) 



lim 



r(s) ds = L c I r{s) ds. 



k(t + s) k(t) 

Hence, the left-hand side of (|5.2p converges to L c J 00 r(s)ds and the claim follows 
from the fact that J °° k(s) ds = — I /{a + J °° k(s) ds). □ 

Example 5.3. Let a > and 

f 



(5.6) 



k(t) 



t > 0. 



(1 + t) Q +! 

We obtain the following convergence rate of the autocovariance function: 

lim c(t)t 1+ 



(-a - 1/a) 3 ' 

Remark 5.4. Examples 13.51 and 15.31 make clear that there is a very different impact 
on the rate of convergence of the autocovariance function from the decay rate of the 
kernel k according as to whether we are in the long-memory or subexponential case. 
In the latter case, the rate of decay of the autocovariance function c is proportional 
to the rate of decay of the kernel fc, so slow decay in the memory as measured by 
the rate of decay of k is reflected exactly in the statistical memory, as measured by 
c. On the contrary, in the long-memory case, a faster rate of decay of the kernel k 
results in a slower rate of decay of c. 

5.2. Discrete time stochastic equation with subexponentially decaying 
memory. Let us now consider the equation (|2.f f j) with a discrete kernel k = {k n : 
n > 1 } satisfying 

(SI') k is a regularly varying sequence with index — f — a for a > 0, 
(S2') a + J2?=i fcj < 0. 

Then k satisfies the assumptions of the Theorem 3.2 in [5] and the fundamental 
solution of (|1.2p converges to zero at the same rate as k: 



(5.7) 



lim — — = 

n->oo kn 



=:L n 



LONG MEMORY VOLTERRA DIFFERENTIAL EQUATION 



IS 



Again, the stationary solution of (|2.11l) exists and the exact rate of decay of the 
autocovariance function can be determined. 

Theorem 5.5. Suppose k satisfy (SI') and (S2 ! ). Let r be solution of (|2.12p . Let 

£ = {£„ : n 6 Z} be a sequence of random variables defined as in Theorem \2.3[ 
Then, the autocovariance function c(-) = Cov(X n , X n +.) of the stationary process 
defined in (|2.13p satisfies 

c(h) a 2 
(5.8) lim = y > 0. 

- a - Y,j=x k 

Proof. The autocovariance function of the stationary solution is again given by 
(I2.14[) . Since (fc ra )neN is a regularly varying sequence, the function x i— s- k(x) := fcr x i 
is a regularly varying function with index — 1 — a. Hence, we may choose the 
function A as in the proof of Theorem 15.21 Since r is absolutely summable, we 
choose for an arbitrary e > a sufficiently large N, so that 2LdJ2^=N+i l r «l < ( - 
Similarly to the continuous case, we split the sum and study each term separately: 

(kq\ V r n+h r n _ y> r n+h k(n + h) X(h) r n+h X(n + h) 

l ' J h> k h ~^ k n+h k(h) rn + Jj +1 k(h)\(n + h) X(h) r - 

The sequence rh/X(h) converges to Ld as h — > oo, so the terms of the second sum 
are bounded for sufficiently large h by 2£d|r n |. Therefore, 



lim sup 

h— ¥QO 



k n 

,=N+1 



<2L d J2 l r «l <( - 

n=N+l 



Let us now consider the first term in (|5.9p . Applying Potter's bound to the function 
k(x) as in (|5.4p we obtain the discrete version of (I5.5|) . Thus, 

N N 
n=0 n=0 

Similarly, X)^°=o r ™ = — V( a + £j=i anc ^ the claim follows. □ 



6. Proof of Theorem 12.21 



First we show that the process defined by (|2.9p has a continuous modification. 
Applying Ito's lemma, Cauchy-Schwarz inequality and Fubini's theorem we obtain 

E((A(i) - X{u)) 2 ) = a 2 [ (r(t - s)l {s < t} - r(u - s)l {s <„ } ) 2 ds 
Jr 

— a 2 J r'(y — s) dv^j ds 
<a 2 {t-u) f f (r'{v~s)) 2 dvds 

JR Ju 

= a 2 {t~u) f f (r'{s)) 2 dsdv 

Ju Jr 

a 2 {t~u) 2 f (r'(s)) 2 ds. 
Jr 

Now, r is square integrable and with ||fc * r\\z,2 < ||fc||x,i||r||x,2, we have r' £ 
L 2 ((0, oo); R). Here, (k*r)(-) denotes the convolution of k and r, given by f Q k(s)r(- — 
s)ds. The Kolmogorov-Chentsov theorem (see e.g [57], Theorem 2.8) yields that 
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X has a continuous modification. It remains to show that the process defined by 
(gH) solves (US). We write 

X(t)-X(0)= f ((r{t-s)-r(-s))dB(s)+ f r(t-s)dB(s) 



-oo JO 
t pt 

/ r'(u- s)dudB(s) +aB(t) 

-oo Jo 

t pt / pU — S \ 

I ar(u — s) + / r(u — s — v)k(v) dv I du dB(s) + o~B(t) 

-oo J0 \ JO J 

t r u pt poo pu—v 

ar{u — s) dB{s) du+ I I I r(u — s — v) dB(s) dv du + aB(t) 
o J -oo Jo Jo J -oo 

rt pt poo 

aX(u)du+ / / k(v)X(u-v)dvdu + aB(t). 
to Jo Jo 

Since r and B are continuous, we are able to apply stochastic Fubini' theorem (e.g. 
[32], Ch.IV.6, Thm. 65), if 

t r t rt rt / ru—s -> 2 

2 



r(u—s) duds <oo and / / / r(u — s — v)k(v) dv ) du ds < oo. 

ooJO J-ooJo \Jo J 

The statement follows from classical Fubini's theorem and the fact that r £ L 2 ([0, oo) 
and ||A;*r|| L 2 < ||fc|M|r|| La . 



7. Poof of Theorem 13.41 

Suppose that r £ C([0, oo); (0, oo)) obeys 

(7.1) r £ RVoo(^) for some n £ (-1, -1/2). 
Since r £ L 2 ([0, oo); M), there exists c : [0, oo) — > (0, oo) such that 

poo 

(7.2) c(i) = / r(s)r(s +t)ds, t>0. 

Jo 

By assuming (|7.1[) . we exclude the possibility that r G L 1 ([0, oo); R). Our first 
result is the following rate of decay of c. 

Theorem 7.1. Suppose that r is a positive continuous function which obeys (I7.1[) 
/or some fi £ (— 1, —1/2). TTien £/ie function c in (|7.2[) is well-defined and moreover 
obeys 

(7.3) lim 4^ = r(-i- 2/x)r(i + ^) 

v y t^ootr 2 {t) r(— //) 

Proof. For /i G (—1, —1/2) we have x^(x + l) M (ix = L. First we suppose that 
r is decreasing. In this case we choose for an arbitrary < e < 1 a (5 = (5(e) > 
such that Jq x^(x + \)^dx < e. The Uniform Convergence Theorem Theorem 
1.5.2) yields that 

r(tx) 

— — > x^, uniformly in x, for all x > 8. 

r(t) 

Hence, there exists a to = to (5) such that 
r(tx)r(t(x + 1)) 



ity 



< 2x ti (x + iy\ for all t > t ,x > S. 
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The function on the right hand side is integrable, hence, the dominated convergence 
theorem yields that 



lim 

t— >oo 



r(tx)r(t(x + 1)) 



dx 



lim r(t X )r(t(x + l)) dx 



POO 

J x^(x + iydx. 



There exists a t\ = t\(S) > to such that 
r(s)r(t + s) 



St 



(7.4) 



< e 



■ ds 

tr{t) 2 

) 

x^(x + lfdx 



L 



r{tx)r(t{x + 1)) 



r(t) 2 
r(tx)r{t{x + 1)) 



dx 



r{t) 2 



dx 



< 2e 



for all t>t\. On the other hand, using the monotonicity of r we obtain 



st 



r(s)r(t + s) 
tr(t) 2 



ds < 



st 



r(s) , R(t) R(6t) 

ds = 

tr(t) r(t)t R(t) ' 



where R(t) = L r(s)ds € RVoo(/i + 1). It follows from Karamata's Theorem [TTj . 
Theorem 1.5.11, that 

R(t) 1 
tr(t) ^ n + 

Choosing 5 small enough and a t<i{5) > ti(6) large enough we obtain 



(7.5) 



<>7 



*M\t 8) ds < 2 lim = 2^-^ < e, 

tr(t) 2 ~ *->°o r [t)t R(t) fi + l 



for all t > t<i- Hence, combining (|7.5I) and (|7.4p we get for all £ > *2 



L 



r(s)r(t + s) 
tr{t) 2 



ds 



< 



L 



r(s)r(t 



st 



tr{tf 



■ ds 



st 



r(s)r(t + s) 
tr(t) 2 



ds < 3e. 



Now, for arbitrary r obeying (I7.1[) . let p(t) := sup{r(i) : t > x}. Then p is a 
positive decreasing function, continuous on [0, oo) and satisfying p(x) ~ r(x) for 
x — > oo [11], Theorem 1.5.3. For an arbitrary e > we choose to = to( e ) such that 
for all t > to we have 

! f°° 

p(s)p(t + s) ds — L 



tp{tf 



< 6. 



Since r(t)/p(t) — » 1 as i — ► oo for every s G (0, 1) there exists t\ = t\{e) > to such 
that 1 - e < r(t)/p(t) < 1 + £ for all £ > ti. Therefore 



(7.6) 



d- £ ) 2 < £ r ! sM : + f: <(i +£ ) 2 . 



/ tl p(s)p(s + t)ds 
For e sufhcicntly small we obtain 

f, 00 r(s)r(s + t) ds 

(7.7) % 1 

ItT p( s )p( s + *) ds 

Now, since p is decreasing, we have for t > t\ 



< 3e. 



(7.8) 



7"(s)r(s + t) ds 



r(s) 



r(s+t) p{s + t) 



ds < (1 + e) / r(s)ds 



p(s + t) p{t) 

Therefore as t >->■ tp(t) is in RVoo(^ + 1) and /i + 1 > 0, we have ip(i) — » oo as 
i — > oo, and so there exists a ^ = ^(e) > *i such that 



r(s)r(s + t) ds 



< e and 



W) Jo 



p(s)p(s + 1) ds 



< e 
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for all t > t<i. Therefore, 
1 



1 f°° 1 [°° 

tpHt) J r(s)r(s + t)ds-L < ^ ^ p(s)p(s + t) ds - L 



tp 2 (t) J 



p(s)p(s + 1) ds 



< 3e 



TpW)L r{s)r{s + t)ds , 
TpW)i r{s)ris + t)ds ~lpW)i p ^ s + ^ ds 

1 r 00 J t °° r(s)r(s + t) ds 

imk p{s)p{s+t)ds " 



< 3e + 3eL = (3 + 3L)e. 



Finally we note that 



lim 



«(*) = Um c(t) p(i) 2 



t— >oo r 



-^-V = inn : ' ' ; ' = lim — ^ 
(i) 2 t^oc p(t) 2 r(t) 2 t^oo 



c(t) 



□ 



We now explicitly connect the result of Theorem 1 7. II to the autocovariance function 
of the stationary solution of (|2.8[) in the case when a = — Jp 00 k(s) ds to prove our 
main result. 



Proof of Theorem [ 
It follows from Theorem 13.21 that 



(7.9) 



lim trlt) • L 2 (t)t l 



sin a7r 



-2/ 



Since a G (0,1/2) we have that r G L 2 ([0, oo); (0, oo)) n C([0, oo); (0, oo)) and 
r G RVoo(a - 1) with p := a - 1 G (-1,-1/2). Therefore by Theorem O and 
Theorem 12.21 obtain 



lim c(t)L 2 (t)t 



lim 

t^oc ir 2 (i) 



,r(l-2a)r(a) sin 2 (7ra) 
r(i - a) ^ : 



as claimed. 



□ 
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